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Abstract 



We consider a disordered system obtained by coupling two mixed even-spin mod- 
els together. The chaos problem is concerned with the behavior of the coupled 
system when the external parameters in the two models, such as, temperature, 
disorder, or external field, are slightly different. It is conjectured that the over- 
lap between two independently sampled spin configurations from, respectively, the 
Gibbs measures of the two models is essentially concentrated around a constant 
under the coupled Gibbs measure. Using the extended Guerra replica symmetry 
breaking bound together with a recent development of controlling the overlap using 
the Ghirlanda-Guerra identities as well as a new family of identities, we present rig- 
orous results on chaos in temperature. In addition, chaos in disorder and in external 
field are addressed. 

. Keywords: spin glass models, chaos 

m 



o 

m 

Oh 



(N 



>< 



1 Introduction and main results 

The chaos problem is a very old one in the spin glass theory. It arose from the discovery 
that in some models, a small change in the external parameters, such as temperature, 
disorder, or external field, will result in a dramatic change to the overall energy landscape. 
Furthermore, it may as well change the location of the ground state and the organization of 
the pure states of the Gibbs measure. It has received a lot of attention and been intensively 
studied in the context of various models in physics literature in the past decades (e.g. see 
[13] for a recent review). In recent years, several mathematical results also have been 
obtained in the problems of chaos in external field and in disorder: An example of chaos 
in external field for the spherical Sherrington-Kirkpatrick model was given in [12] . Chaos 
in disorder for mixed even-spin models and without external field was considered in [2], 
[3] and a more general situation in the presence of external field was handled in jl]. 

According to physicists' viewpoint PQ El E], chaos in temperature presents intricate 
difficulties that are very hard to be analyzed both theoretically and experimentally, mainly 
because this effect is exceedingly small in the perturbation theory. So far mathematically 
rigorous results are still very scarce. To the best of our knowledge, the only known result 
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is a "weak" form of chaos in temperature studied in the mixed p-spin models [5]. In this 
paper, we will focus on the mixed even-spin model and investigate its chaos problem in 
temperature. Using Guerra's replica symmetry breaking bound combining with a recent 
development on the control of the overlap using the Ghirlanda-Guerra identities and a 
new family of identities, we will present mathematically rigorous results for chaos in 
temperature. In addition, more general cases of chaos in disorder are considered and 
results of chaos in external will be addressed. 

Let us introduce the mixed even-spin model and the formulation of the chaos problem 
as follows. Let j3 = (f3 p ) p >i be a sequence of real numbers with J2 P >i 2 2p Pp < °o. To 
avoid triviality, throughout this paper, we assume that (3 P ^ for at least one p > 1. 
Let h be a r.v. such that its moment generating function exists on R. Given N > 1, we 
consider a family of i.i.d. standard Gaussian r.v. 

Q = (9h,.,i2 P ■ VI < k, ■ ■ ■ M v < N, Vp > 1) (1.1) 

and a family of i.i.d. copies of h, {hi)i<N- These two families of r.v. are independent of 
each other. The pure 2p-spin Hamiltonians X NtP (cr) for p > 1 indexed by cr e T, N := 
{ — 1, +1}^ is defined as 

l<*l,...,12p<JV 

The mixed even-spin Hamiltonian is defined as a linear combination, 

H N {tr) = X n {(t) + hi°i, (1.3) 

i<N 

where 

X N {a) :=J2^p X ^p( <t )- ( L4 ) 
P >i 

In physics, the sequence (3 is called the (inverse) temperature parameters, the family of 
r.v. Q is called the disorder of the system, and h is called the external field. The covariance 
of the Gaussian process can be easily computed as 

EXxi^Xxi* 2 ) = NZ(R(<t\<t 2 )), 

where the quantity R^er 1 ,^ 2 ) := iV -1 J2i<n a l a f ls called the overlap between two spin 
configurations cr 1 , a 2 G S^v and £(x) := 5T p>1 (3pX 2p . We define the Gibbs measure Gn on 
Stv by 

expgjv(cr) 

Gn{ct) = , (1.5) 

ZjN 

where the normalizing factor Zjq is called the partition function. An important case of 
this model is the famous Sherrington-Kirkpatrick (SK) model [15] ; where /3i tP = 02, P = 
for all p > 2. Now consider two independently sampled spin configurations cr 1 and cr 2 
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from Gn- It is well-known that under the measure KGn x Gn, the overlap R{cr 1 ) (T 2 ) is 
essentially concentrated around a constant in some part of the high temperature region, 
where this region is defined as the set of all temperature parameters such that the infimum 
in the Parisi formula (see Subsection 12. II below) is achieved by a Dirac measure. While in 
the low temperature region, i.e. out side the high temperature region, the overlap is lack 
of self- averaging property [TT] and is conjectured to have a nontrivial weak limit, called 
the Parisi measure. One typical way of measuring the instability of this spin system 
occurred by the change of external parameters is to sample independently cr from Gn 
and r from a new Gibbs measure G' N using a perturbed external parameters from Gn 
and consider the behavior of the overlap R(cr, r) under MGn x G' n . The phenomenon of 
chaos states that this overlap behaves very differently and is indeed concentrated near a 
constant no matter that the two systems Gn and G' N are in the high or low temperature 
regime. This is precisely the statement that we will be proving in the paper under some 
mild assumptions on the external parameters. 

Let us define two mixed even-spin models and specify their external parameters in the 
following. Recall Q from ( II. lj) . Let Q 1 and Q 2 be two copies of Q such that they together 
form a jointly Gaussian process. In addition, for every 1 < z 1; . . . , i 2p < N and p > 1, the 
pair (gl u _ t i 2 , Qi^fap) is independent of each other and 

^•9i 1 ,...,i 2 p9i 1 ,...,i 2p = tp ^ [0, 1]- 

Suppose that h 1 and h 2 are two r.v. that do not depend on Q 1 and Q 2 and their moment 
generating functions exist on R. Let (h},h 2 ) be i.i.d. copies of (/i 1 ,^ 2 ) for 1 < i < N 
independent of Q l and Q 2 . We consider two mixed even-spin models with Gibbs measures 
G N and G 2 N corresponding to the Hamiltonians H N (er) and H n (t) as in ( II. 3ft . 

H N {cT)=X N {*) + Y, h1 ^ 

^ (1-6) 
H 2 N (T) = X 2 N (r) + Y,hh, 

i<N 

where X N (er) and X n (t) are defined similarly as ( II ,4p for cr, r G T, N using /3 1; Q 1 and 
j3 2 , G 2 , respectively. Then the covariances of X N and X N can be easily computed as 

EX^a^X^a 2 ) = N^R^a 1 , a 2 )), 
EX 2 n (t 1 )X 2 n (t 2 ) = N& >2 {R{t\t 2 )), 
EX^a^XUr 1 ) = N^ 1)2 (R(cr 1 , r 1 )), 

for cr 1 , C r 2 , T i, T 2 GS iV , where 

p>i p>i p>i 

We will denote by (er e ,T e )i>i an i.i.d. sequence of replicas from the measure G N x G 2 N 
and by (•) the Gibbs average with respect to (G N x Gfy)^ 00 . One may regard the pair of 
Gibbs measures (G]^,G%) as (Gn,G' n ) mentioned above. 
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Now we present our main results. The first one is concerned with chaos in temperature, 
namely, the behavior of the overlap R(cr, r) between two systems G l N and G 2 N at different 
temperatures f3\ and /3 2 . For j = 1, 2, let 

X j = { p e N : p jip ± 0}. 

We introduce a family of subsets of natural numbers, 

Co = {X C N : linear span of 1 and (x 2p ) pe x is dense in (C[0, 1], || • ||oo)}- 

Note that the Miintz-Szasz theorem (see Theorem 15.26 [H]) provides a very simple 
criterion: X G Cq if and only if ^„ g j 1/p = oo. Define the following mild conditions on 
the temperature parameters (3\ and /3 2 : 

(C*i) There exist ^CIj and p G X x \ A such that „4 G C and for some veRwe have 
/?2, P = ^/3i, P for all p G „4 and /3 2 , PO ^ v fi\w 

(C 2 ) There exist ACI 2 and po G X 2 \ A such that „4 G C and for some vGlwe have 
0l, P = vf32, P for all p G A and /?i jPQ 7^ vfi 2 ^ . 

Two important examples of /3i and /3 2 satisfying both conditions (Ci) and (C 2 ) are 
that we add higher order spin interactions to the SK models and perturb either the SK 
temperatures or the higher order spin interaction temperatures at the same rate: 

Example 1. /3 2 p 7^ for all p > 1 with flu 7^ 02,i an d 0i )P = 02, P f or all p > 2. 

Example 2. 0x tP , 2 , P 7^ for all p > 1 with Pi t i = f3 2 ,i and for some v =fi 1, 0x tP = vfii, P 
for all p > 2. 

Theorem 1 (Temperature chaos). Let h 1 and h 2 be jointly Gaussian. Suppose thatt p = 1 
for all p > 1 and that Ii and X 2 satisfy (Ci) and (C 2 ) ; respectively. IfM^) 2 = /or 
j = 1 or 2, then 

lim E(I(\R(cr,r)\ > e)) = 0, > 0. (1.8) 

AT— s>oo 

//Var(/i J ) 7^ /or 6ot/i j = 1,2, t/ien i/iere exists some constant Uf such that 

lim E (J([i?(cr, r) - u f \ > e)) = 0, > 0. (1.9) 

Theorem [j] is the first rigorous chaos result in temperature in the mixed even-spin 
model. It indicates the sensitivity of the model to the change of temperatures. However, 
due to technical reasons, it remains unknown how to verify fll.8p and (11. 9p in the setting 
of the SK model, i.e. (3i^ 7^ /3 2) i and 0i tP = /3 2)P = for all p > 2, which seems by far 
the most interesting case to physicists. Let us remark that the constant Uf in Theorem 
[Tj as well as in Theorems [2] and [3] below could possibly be equal to zero. For instance, as 
one will see in Proposition [3X if h l and h 2 are independent and symmetric with respect to 
the origin, then Uf = 0. The determination of Uf is a highly technical issue. It is indeed 
the unique fixed point of a function related to Parisi' formula and measures that will be 
discussed in Section HI 
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Next, let us turn to our main results on chaos in disorder. In this problem, we want 
to know the behavior of the overlap in the coupled system occurred by the change of the 
disorders. The first rigorous study of this problem without external field was given in 
[3] and later more general situations of the models with external fields were handled in 
[I]. In view of the arguments therein, for technical purposes, the Hamiltonians for the 
two systems are assumed to be identically distributed. We prove that chaos in disorder 
is still valid even when two Hamiltonians do not have the same distribution if some mild 
conditions on the temperature parameters are added. The following is our main result. 

Theorem 2 (Disorder chaos). Let h 1 and h 2 be jointly centered Gaussian r.v.. Suppose 
that 0<t p <l for some p G Xi H Z 2 . If E(h j ) 2 = and Xj E C for j = 1 or 2, then (O]) 
holds. IfV&r(h j ) ^ and Zj E C for both j = 1, 2, then §TM) holds. 

Lastly, suppose that the two systems use the same temperature parameters and disor- 
ders, i.e. fii = f3 2 and t p = 1 for all p > 1. We would like to know how the overlap R(cr, r) 
in the coupled system is influenced when the external fields h l and h 2 are essentially dif- 
ferent from each other. To begin with, let us give a counterexample to illustrate that the 
chaotic property does not always hold for arbitrary choices of h 1 and h 2 . For instance, 
one may consider h 1 and h 2 having the relation h 1 = —h 2 . Since £i i — £2,2 — £12 is even, 
one may check easily that 

(X^+X^t^tgEjv) 

and 

{X 1 n {(t) + X 2 n {-t) : <t,t EY, N ) 

have the same joint distribution. Thus, using h 1 = —h 2 and change of variables — r — > r, 
for every Borel measurable subset A of [—1, 1], we obtain 

EGjv x G 2 N ({(a, t) : R(tr, r) E A}) = EG], x ^({(tr 1 , a 2 ) : R(tr\ a 2 ) E -A}), 

where —A := {— x : x E A}. As we have mentioned before, since the limiting distribution 
of the overlap under EGjy x G], is nontrivial in the low temperature regime, we can 
not witness chaos in this case. Thus, in order to capture the chaotic feature, further 
assumptions on the external fields are required. Our theorem below provides one possible 
choice of h 1 and h 2 by assuming that they are different in disorder. 

Theorem 3 (External field chaos). Suppose that j3\ = 02 and t p — 1 for allp > 1. Let h l 
and h 2 be two r.v. having the same distribution. 7/E(/?, 1 ± h 2 ) 2 ^ 0, then for any e > 0, 
there exists some positive constant K independent of N such that for all N > 1, 

E(I(\R(<r,T)-u f \ > e))<K expf-^J (1-10) 

for some constant Uf. 

Apparently, f ll.lOp is much stronger a chaos result comparing to those in Theorems [1] 
and 121 The main reason will be illustrated in our proof sketches for which we are going to 
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discuss now. This paper is mainly motivated by two recent works [I] and [5]. We consider 
the coupled free energy, 



mM :=-Elog ex P ( H »(°) + H *W) ( L11 ) 

R(cr ,t)=u 

for u G Sn '■= {i/N : —N < i < N} and analyze this quantity via an extended Guerra 
replica symmetry breaking bound. Suppose that /ip and p? P are the Parisi measures (see 
Definition [2] below) corresponding to the two systems, respectively. Set c\ = minsupp/ip 
and C2 = minsupp/zp. We show that this bound naturally gives rise to a function that 
determines Uf and implies the statement that for any e > 0, there exists some e* > such 
that if N is sufficiently large, then 

PN ,u<^ElogZ l N + ^ElogZ 2 N -e* (1.12) 

for all u G Sn with \u\ < y/viV2 and |w — w/| > e, where t>i > ci and t>2 > C2 are two 
constants independent of N and and Z N are the partition functions of the two systems. 
From this, a standard application of concentration of measure for disorders Q 1 ,Q 2 and 
external fields (h])i<i<N, (hj)i<i<N means 

E(I(\R(<t,t)\ < ^T 2) \R((T,T)-Uf\>e)<Keiq>(-^\ (1.13) 

for all iV > 1, where K > is a constant independent of N. One would like to expect 
that using appropriate choices of parameters for Guerra's bound also implies ( 11.121) for 
all u G Sn with \u\> sjv^v?, and again from concentration of measure, 

E(I(\R(v,t)\ > < i^exp f-^\ (1.14) 

for all iV > 1. This together with f II . 1 3 j) will then yield an exponential bound as fll.lOp . 
It turns out that f)1.14p can be successfully carried out and will be our main approach to 
the problem of chaos in external field as in Theorem [3j which relies heavily on the fact 
that the Hamiltonians in the two systems are identically distributed. Unfortunately, in 
the setting chaos in temperature or disorder, this fact is generally not valid that creates 
highly intractable difficulties of choosing parameters in Guerra's bound. To resolve this 
technical issue, we will adapt another approach j5] by considering the Ghirlanda- Guerra 
identities and developing a new family of identities for the coupled system under the mild 
assumptions on the temperature parameters and disorders. These two families of identities 
contain the information about how the spin configurations between two systems interact 
with each other that allows us to control the overlap R(cr, r) between the two systems by 
using the overlaps Ricr 1 , cr 2 ) and ^(r 1 , r 2 ) from the individual systems. Ultimately they 
lead to a weak result, 

lim E(I(\R((T,t)\ > y/v^)) = 0. 
This and (11.131) together imply the conclusions of Theorems [T] and [21 
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The rest of the paper is organized as follows. Section [2] is devoted to studying some 
basic properties of Parisi's measures that are needed in our chaos results. In particular, 
we prove that in the absence of external field, the supports of Parisi's measures always 
contain the origin for all temperatures. The central proof of this result is played by a 
fundamental fixed point theorem that will be used later to determine the constant Uf in 
Section HI Section [3] begins by recalling the extended Guerra's replica symmetry breaking 
bound for the coupled free energy (11. lip . We will choose parameters for this bound to 
derive a manageable bound for the coupled free energy in terms of a function 4> VljV2 as in 
(14. ip below and the Parisi formulas for the two systems. In Section HI we will investigate 
the behavior of the overlap R(ct,t) inside the interval [— ^/cic 2 , x/cic 2 ]. The argument 
relies on the fixed point theorem established in Section [5] that allow us to determine Uf 
and to derive an exponentially tail control fll . 13 j) . In Section [51 we demonstrate how to use 
the given conditions in Theorems [I] and [2] to derive the Ghirlanda-Guerra identities and 
a new family of identities for the coupled system. They together with an application of 
the Cauchy-Schwartz inequality provide an approach to controlling the overlap R(cr, r) 
via ^(er 1 ,^- 2 ) and ^(t^t 2 ). Finally, we combine all results in every section to prove 
Theorems [TJ [2j and [3] in Section 6. 

Acknowledgements The author would like to thank Antonio Auffinger for his careful 
reading and several suggestions regarding the presentation of the paper. 

2 Properties of Parisi's measures 

The Parisi formula and measures are intimately related to the investigation of chaos 
problem as they will induce a crucial function that determines the location at where the 
overlap i?(<x, r) in the coupled system is concentrated, see Sections El and 0] below. In 
this section, we will recall their definitions and study the support of the Parisi measures. 

2.1 Parisi's formula and measures 

For given temperature (3 and external field h, recall the Gibbs measure Gn and partition 
function Zn from ( 11. 5ft . In statistical physics, the thermodynamic limit of the free energy 

p N := ^E\ogZ N 

is one of the most important quantities that describes the macroscopic behavior of the 
system. It can be computed by the famous Parisi formula described below. For any given 
integer k > 0, let m = (m p )o< p <A:+i and q = (q p )o< P <k+2 be real numbers satisfying 

m = < mi < • • • < m k < m k+1 = 1, 
qo = < qi < • • ■ < qk+i < qk+2 = l. 

One may think of this triplet (k, m, q) as a probability measure /i on [0, 1] that has all 
of its masses concentrated at a finite number of points qi, ■ ■ ■ ,qk+i and /i([0,g p ]) = m p 
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for < p < k + 1. Let z , . . . , z k+ i be independent centered Gaussian r.v. with ¥,Zp = 
— £'(qp) for < p < k + 1. Starting with 

= log cosh I h + ^ z v ) > 

we define decreasingly for 1 < p < A; + 1, 

X p = — log E p exp m p X p+1 , 
m p 

where E p means the expectation on the r.v. z p , z p+ \, . . . , z k+ \. If m p = for some p, we 
define X p = E p X p+1 . Finally, we define X Q = EJfi. Set 

^ fe+i 

P fc (m, q) = log 2 + X - - ^ m p (^(g p+1 ) - (2.2) 

P =i 

where 8(x) := x^'(x) — ^(x). The importance of this quantity lies on the fact that it yields 
Guerra's bound for the free energy [8], 

p N <V k (m,q) (2.3) 

for any given triplet (fc,m, q). Usually, we call ^(m, q) the replica symmetry bound if 
k = and the k-th level replica symmetry breaking bound if k > 1. Set 

P{£,h)= inf P fc (m,q), (2.4) 

(fc,m,q) 

where the infimum is taken over all triplets. The Parisi formula states that the thermo- 
dynamic limit of the free energy is given by the variational formula ( 12 ,4f> . 

lim p N = V(£, h). 

This formula is first rigorously verified in [16]. Let us define a functional V(!;,h,-) on 
the space of all probability measures on [0,1], that are consisted of a finite number of 
jumps, by letting V(£, h, /i) = Pfe(m, q) if /i corresponds to the triplet (k, m, q). It is well- 
known [8] that this functional is Lipschitz continuous with respect the metric d(/j,, //) = 
Jq 1 |/i([0,x]) — fi'([0,x'])\dx. Thus, we can extend /i, •) continuously to the space of 
all probability measures on [0, 1] and for simplicity, we will still denote this extension 
by h, •). This then allows us to replace the infimum in the Parisi formula by taking 
minimum over all probability measures on [0, 1]. 

Definition 1. Let fi be a probability measure corresponding to the triplet (k, m, q). Given 
e > 0, we say that fi satisfies condition MIN(e) if the following occurs. First, the sequences 
m = (m p ) < p < fc+ i and q = (g p ) <p<A;+2 satisfy 

m — < mi < • - • < m k < m k+ i = 1 
go = < qi < ■ ■ ■ < q k +\ < q k +2 = 1- 
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In addition, 

V k (m,q)<V(Z,h)+e 

and 

"Pfc(m, q) realizes the minimum ofVk over all choices of m and q. 

Let us remark that for any given e > 0, one can always find a \x G MIN(e) by 
Lemma 14.5.5 and Proposition 14.7.5 in [18]. In addition, if Kh 2 ^ 0, then one further 
has qi > 0. As one might expect, there may have several minimizers to Parisi's formula. 
Among possibly many minimizers, we are particularly interested in those, called the Parisi 
measures fip defined below. 

Definition 2. A probability measure fip is called a Parisi measure (corresponding to the 
function!; and external field h) if it is the weak limit of a sequence of probability measures 
fi n G MIN(e n ) for some sequence of real numbers (e n ) n >i with e n 4- 0. 

In physics, it is conjectured that the Parisi measure is unique and it is the limiting 
distribution of the overlap. Under suitable technical assumption on /3, such as (3 P ^ 
for all p > 1, these statements are verified to be valid, but the general situation remains 
open. 

There are two basic properties about the Parisi measures and the overlap that are of 
great importance and are intimately related to the study of chaos phenomena. First, in 
the presence of external field, Eh 2 ^ 0, they satisfy a positivity principle, namely, for any 
Parisi measure /ip, we have that 

c := inf supp/ip > (2.5) 

and for all d < c, 

EG N x G N {{(a\ a 2 ) : R(ct\ a 2 ) < d}) < K exp ^-^J (2.6) 

for all N > 1, where K is a positive constant independent of N. This result can be found 
in Section 14.12 [18J. The second property is concerned with their behavior in the absence 
of external field, ¥,h 2 = 0. It is believed according to physicists' numerical simulations 
[TO] that in this case the origin is contained in the support of the limiting distribution of 
the overlap. It turns out that mathematically there are several approaches to verify this 
observation in the high temperature regime (see Chapter 1 [18J) but it is by no means 
clear how to attack this problem in the low temperature regime. In this paper, we prove 
that at least this observation is true for the Parisi measures. Below is the statement of 
our main result. 

Theorem 4. For any f3, if~Eh 2 = 0, then G suppfip for every Parisi measure fip. 

Although in this paper Theorem H] will only be used to derive our chaos results, it is 
also of independent interest in understanding the structure of the pure states of the Gibbs 
measure. Let us remark that in the spherical Sherrington-Kirkpatrick model without 
external field [12] . the Parisi measure consists of a single point mass at some c > 0, which 
is very different to our result in Theorem HI 



9 



2.2 An auxiliary function and a fixed point theorem 

The central rhythm of the proof for Theorem [4] and our results on chaos are played by an 
auxiliary function and a fixed point theorem given below. Suppose that \x is a probability 
measure corresponding to some (k,m, q). Recall Xo from (12. 2 j) by using this triplet. A 
very nice property about this quantity says that it can also be computed as E$ M (/i, 0), 
where <3> M : K x [0, 1] — > R is the solution to the following PDE, 

with $ M (x, 1) = log cosh x. Let /ip be a Parisi measure and (/x n ) n >i be any sequence of 
probability measures consisted of a finite number of point masses that converges weakly 
to lip . Let be the PDE solution (12. 7ft associated to fi n . From the Lipschitz property 
of the Parisi functional, one sees that ($ Mn ) n >i converges uniformly on E x [0, 1]. Define 

$ MP = lim (2.8) 

n— >oo 



Note that from the Lipschitz property of the Parisi function, $ MP is indeed independent 
of the choice of the sequence (/i n ) n >i- Let us summarize some further properties about 
that will be used throughout the paper in the following proposition. 

Proposition 1. The following facts hold for <3> Mp . 
(a) For < j < 3, lim^oo ^f- = uniformly on R x [0, 1]. 

(h) ||®*2£.|| <1 0<inf d2 ^ p < II d2 ^ p II <1 and II ^£-11 <4 

V / || Qj. ||oo _ ^; u ^ lm £ Q x 2 ~ || ^2 ||oo _ U/tU || ^3 \ <± . 

( c ) ^^(''^ w °ddfor any q. 

(d) If Eh 2 7^ 0, recalling from 1 12. 5ft . we have that c > and 

E(-^(* + x,c) 

em(^f{h+x,c)\ <i, 

where x is centered Gaussian with E% 2 = £'(c) and zs independent of h. 

Proof. The proofs for j = 0, 1 in the first statement are given in the proof of Theorem 3.2 
[T7] . One may see that indeed a similar but much more tedious argument as Theorem 3.2 
[T7] will also yield the cases for j = 2,3. The second and third assertions are concluded 
from Lemma 14.7.16 [18] and Lemma 2 [4]. Finally, the fourth statement is exactly Lemma 
12 TJ. 

□ 

Recall £1,1, £2,2, and £i )2 from (jl.7p . Let us note that the two sequences /3i and /3 2 in 
the definitions of £1 1 and £ 2 2 are nontrivial. Below is our fixed point theorem. 



10 



Theorem 5. Let c\,c 2 be any two numbers satisfying < c\,c 2 < 1 and h},h? be any 
two r.v. Suppose that Fi,F 2 are real-valued functions on R with \\FjWoo, H-F^'Hoo < 00 an d 
< inf Fj < HFjlloo < oo for j = 1, 2. Z>e/me 

F(ix) = Ei^/i 1 + X l )F2(h 2 + x 2 ) (2.9) 

/or \u\ < Jc\c 2 , where x 1 ~,X 2 are jointly centered Gaussian independent ofh},h 2 with 
HX 1 ) 2 = ^(ci), E(x 2 ) 2 = £ 2 , 2 (c 2 ), ExV = £i»- // 

EF .(^ +xJ )2 = c . ; ( 2.io) 

^.(c f )Ef}(^+^) 2 <l, (2.H) 
t/ien -F maps [— a/cIc^, y/c\c^\ to itself and F has a unique fixed point Uf. 

Proof. Note that from the Cauchy-Schwartz inequality, |£ 12 (ix)| < £i i(ci) 1/1,2 £2 2( c 2) 
whenever \u\ < yJc\C2- So F is well-defined. Using the Cauchy-Schwartz inequality again 
and (I2.10p yield that F maps [—^/c\C2, \/c\c 2 \ to itself. By the virtue of Banach's fixed 
point theorem, to prove that F has a unique fixed point, it suffices to show that \F'(u) \ < 1 
for all | ix | < sJc\Ci- Note that from the nontriviality of j3\ and /3 2 , i(ci), Cli( c i)i £'2 2( c 2)> 
£ 22 (c 2 ) > 0. Now we write 



X 1 = yJ&,i(ci)(Vv(v) w + V 1 -v(u)v>i), 

X 2 = \J £2,2^2) (sign(ix) v 7 v(u)w + ^1 -rj(u)w 2 ), 

where w,wx,w 2 are i.i.d. standard Gaussian and rj{u) = £1 2 (M)/£i i(ci) l72 £ 2 ^c^) 1 / 2 . 
A direct computation using Gaussian integration by parts together with the uniform 
boundedness of the first and second partial derivatives of Fi and F 2 leads to 

F\u) = ^ 2 {u)EF[{h l + x 1 )^ 2 + x 2 ), |«| < y/w. 

Note that £" 2 is an even function and from the Cauchy-Schwartz inequality, £'{ 2 { u ) < 
£1 i{ c iY £2 2{ c 2)^ 2 f° r l n l < \J C \ C 2- This and (12.111) together with another application of 
the Cauchy-Schwartz inequality imply that for all \u\ < ^c\C2, 

pa ( u ) 

\F'(u)\ = - ^ V/2 ^Z 2 < EZ X Z 2 < (EZ?)V»(E2*) 1/a < 1 (2.12) 

£l,l( C l) 7 &,2(C2) 1/2 

where 

Zi ■= Zliici^FKh 1 + x 1 ) and Z 2 := ^Y^F^h 2 + X 2 ). 
If |F'(ii )| = 1 for some |ix | < y/c^, then fl2TT2|) implies EZ X Z 2 = 1. Thus, from (l2TTTp . 
E(Z 1 - Z 2 f = EZ 2 + EZ 2 - 1EZ X Z 2 < 2 - 2 = 

and so Z\ = Z 2 . Now, on the one hand, since 77(1x0) < 1 and £ 1:L (ci), £ 2j2 (c 2 ) > 0, we have 
^(h 1 + x 1 £ Oi, h 2 + x 2 £ O2) > for all open subsets 0%, 2 . On the other hand, from 
inf Fj < supFj, F'a is not a constant function. These two facts together with ^ii(cj), 
£ 22 (c 2 ) > imply that Z\ 7^ Z 2 has nonzero probability, a contradiction. So |F'(u)| < 1 
for all I u I < ^C\C 2 and this completes our proof. 
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2.3 Proof of Theorem H 



To motivate our approach, we will first consider the case that /ip is a replica symmetry 
solution to the Parisi formula, i.e. /xp({c}) = 1 for some < c < 1. We then continue to 
study the case that /ip is a replica symmetry breaking solution, i.e. fip is nontrivial. As 
one shall see, the argument for the second case is exactly the same as that presented in the 
first case. Only now added complications resulting from the more complicated structure 
of /ip has to be treated subtly. 

Proof of Theorem [4] for replica symmetric /ip: Assume that /ip({c}) = 1 for some 
c G [0, 1]. Suppose on the contrary that < c < 1. Recall the Parisi functional Vo(m, q) 
from (12. 2D . where m = (0, 1) and q = (0, q, 1) for < q < 1. First, observe that 

^(m,q) = ^"(g)(g-Etanh>v/^))) 

and this function is > at q — 1, where w is standard Gaussian. We conclude that c < 1 
and thus, c satisfies 

Etanh 2 F = c, (2.13) 

where Y := w^'(c) 1 ^ 2 . Next, recall a well-known result of Toninelli [19], which says that 
above the Almeida-Thouless line, i.e. £"(c)E cosh -4 Y > 1, the Parisi measure could not 
be replica symmetric. Let us notice that although Toninelli's original theorem is dedicated 
to the SK model, one may find that indeed a similar argument as [19J or Section 13.2 
will yield Toninelli's theorem in the mixed even-spin model. Thus, we obtain 



1 

~cosh 4 y 

Now consider the PDE solution corresponding to /ip from (12. 7\i 

1 
2 



r(c)E— — < 1. (2.14) 



$ MP (x, c) = log cosh X + - (f '(1) - f '(c)). 



Let = £ 2 ,2 = 6,2 = £, F x = F 2 = - ^(-,c) = tanh, h 1 = h 2 = 0, and c a = c 2 = c 
in Theorem From (T2TT3|) and fl2TT4D . Fi and F 2 obviously satisfy OTTOl) and fl2~Tll . 
Therefore, the function F defined from (12.91) must have a unique solution. However, since 
F\ and F are odd functions, one may see clearly that and — c are also fixed points of F, 
a contradiction. So c = and this completes the argument of the case that /ip is replica 
symmetric. □ 



Proof of Theorem [4] for replica symmetric breaking fip: Assume now that /ip 
is nontrivial and c = minsupp/ip > 0. Note that since /ip is not replica symmetric, we 
can further assume < c < 1. Recall from (12.81) . One would like to expect that 
similar results as (12. 13ft and (12. 14p also hold for $ MP such that one can apply Theorem 
[5] to conclude Theorem @J It turns out that under the assumption c > 0, we have the 



12 



following, 



E (^ (X ' C) ) 2 = C ' (2 ' 15) 

e " (c)E (^^ (X ' C) ) - 1 ' (2 ' 16) 

where \ denotes the centered Gaussian r.v. with E% 2 = £'( c )- Suppose for the moment 
that (12.15j) and (12.161) hold (They will be verified below). From Proposition [5] using 

6,1 = 6,2 = 6,2 = 6 F\ — Fi = ^ £ "('' c), h 1 = h 2 = 0, and ci = c 2 = c, the function F 
defined at (I2.9p has a unique fixed point, but this contradicts to the fact that and — c 
are also the fixed points of F since (■, c) is odd from (c) in Proposition [TJ Therefore, 
c has to be zero, which finishes the proof of Theorem HI □ 



The rest of this subsection is devoted to the derivation of (I2.15P and (I2.16P assuming 
c > 0. The basic idea is to study the local stability of the Parisi solution /ip in the Parisi 
formula as performed in (I2.13P and in Chapter 14 [18j. Suppose that (k, m, q) is a triplet 
corresponding to a measure fi. Recall "Pfe(m, q) from (12.21) . Since we will be differentiating 
this quantity with respect to q p s and m p s and the definition of X in V k (m, q) involves 
an iteration scheme, for convenience, we define a sequence of functions (^4 p )o< P <fc+2 as 
follows. Let (<2 p )o<p<fc+i be independent centered Gaussian with Kz 2 = £'(q p+1 ) — (,'(q p ). 
Starting from A k+2 (x) = log cosh x, we define decreasingly for < p < k + 1, 

AJx) = —\ogE expm p A p+1 (x + Zp), (2-17) 

m p 

where we define A p (x) = KA p+ i(x + z p ) whenever m p = 0. Note that X = KA (h). Let 
^ be the PDE solution (I2.7P corresponding to fi. Easy to see $ M (x, 1) = A k+2 (x) and 
more importantly, a direction computation using Gaussian integration by parts implies 
that $ M can be represented in terms of (^4 p )o< P <fc+2? 

$n(x,q) = — logEexp m p A p+1 (x + zJ?( qp+1 )-?(q)) (2.18) 
m p V / 

whenever q p < q < q p+ i for some < p < k + 1, where z is standard Gaussian. In 
particular, for < p < k + 2, 

$^x,q p )=A p (x). (2.19) 

Set (Cp)i< P <k+2 by letting 

and set (W p )i< p < k+1 by 

W p = expm p (A p+1 (( p+1 ) - A p (( p )). 

Now suppose that k > 1 and fi G MIN(e) for some e > 0. Let < s < k + 1 satisfy 
9s < c < g s+ i. A study of the local stability of fi in V k yields the lemma below. 



0<n<p 
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Lemma 1. Suppose that there exists some < d < c such that d > e x l % . If q s > d , th 



en 



EW 1 ---W e - 1 A' a (Q 2 = q a , (2.20) 
e(q s )EWx ■ ■ ■ W^A'XQ 2 < 1 + Ms 1 / 6 , (2.21) 



where M > depends only on £ and d . If q s +i < 1, then 

EW 1 ---W s A' s+1 (( s+1 ) 2 = q s+1 , (2.22) 
rWiW • • • W S A': +1 (( S+1 ) 2 < 1 + Me 1 / 6 , (2.23) 

where M > depends only on £ and c. 

Proof. To obtain (I2.20p and (12.22p . suppose for the moment that one thinks of Pfc(m, q) 
as a function defined on the space of all vectors (m p )o< p <k+i and (g p )o< P <fc+2 satisfying 

m = < mi < m 2 < ■ ■ ■ < rrik < rnk+i = 1, 
<?o = < gi < g 2 < • • • < <?fc+i < Qk+2 = 1. 

If gi = 0, a direct differentiation of "Pfc(m, q) with respect to g r for 2 < r < k + 1 implies 

^-V k (m, q) = ~K - m r _ 1 )e"(g r )(-EW 1 • • • W^^Cr) 2 + q r )\ (2.24) 
ag r 2 

if q± > 0, then (12. 24[) also holds for r = 1. For the detailed computation, one may refer to 
Proposition 14.7.5 in [18]. Since (k, m, q) 6 MIN(e), it implies that ^-"Pfc(m, q) = for 
either r > 2 or r = 1 with gi > 0. Consequently, 

EWi • • • W r _i^,(C r ) 2 = q r (2.25) 

for either r > 2 or r = 1 with gi > 0. In particular, if the condition g s > c' holds, then 
1 < s < k + l and so f!2T2Uj) holds from with r = s; if g s+1 < 1, then 1 < s+1 < fc + 1 

and since g s+ i > c, using (12.251) with r = s + 1 implies f)2.22p . 

For (ELD) and fl2T23D . recall that the triplet (fc, m, q) e MIN(e) satisfies 

m = < mi < m 2 < ■ • • < < m^+i = 1, 
go = < gi < g 2 < ■ • • < gfc+i < Qk+2 = 1. 

Consider new lists of sequences, for 1 < r < A; + 1, 

m(m) = (0, m 1; . . . , m r _i, m, m r , . . . , m^, 1), 
q( M ) = (0, gi, . . . , g r _i, m, g r , . . . , q k+1 , 1), 

with m r _i < m < m r and g r _i < u < q r . For 1 < r < A; + 1, we define 

M*0 = ~— Pfc+i( m (^) ; q(«)) 

^ m m=m r _i 
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Let us observe that from the definition of / and (k, m, q) £ MIN(e), 

f r {q r ) = 0, VI < r < A; + 1, (2.26) 
/ r (g r _i) = 0, V2 < r < fc + 1. (2.27) 

Here comes the most critical part: there exists a constant M > depending only on £ 
such that for every 2 < r < + 1, 

f r (u) > -My/e, Vg r _i < u < q r , (2.28) 

/;(9r) = -\C(q r ) (EWi ■ ■ • ^-^(C) 2 - g,) , (2.29) 

/r (*) = -^"(?r) " " " Wr-l^(Cr) 2 " l) (2-30) 

and if q\ > 0, these also hold for r = 1. In addition, for 1 < r < k + 1, 

max |/;»| <M. (2.31) 

The inequality (l2~28l) is mainly due to (k, m, q) e MIN(e), while (12T29]) . fl2T30|) . and (12311) 
are based on a series of applications of the Gaussian integration by parts formula. Again, 
since they have been carried out in great detail in Section 14.7 [T5], we will omit the 
derivation of these results. Now, using Taylor's formula together with (I2.25p . (|2.26p . 
( I2.29p . and (|2.3ip . if either r > 2 or r = 1 with qi > 0, we have 

fr(u) < - q r ) 2 f?(q r ) + M\u - q r \\ (2.32) 

Suppose that q s > d. Then 1 < s < k + 1. First, we assume 

u = q s - £ 1/6 > g 8 _i. (2.33) 
Using (jPED and Q75^|) with r = s yields 

-My/i < \e l ^f:{q s ) + My/1 

and this implies from (I2.30p . 

-f'JiQs) = ^"(qsW^Wt ■ ■ ■ W^KiQ 2 - 1) < 4M6 1 / 6 . 

Since £"(c') < £"{q a ), (12T2Tj) clearly follows. Assume now that (12331) fails. Since d > e 1 ^ 
and q = 0, we have s > 2. Therefore, the use of (12.271) . (I2.30p . and (I2.32p with r = s and 
u = leads to 

-fs(q s ) = i^(g.)(^(g.)EWk • • • W._x<(C.) a - 1) < 2A%, - g s _0 < e V6. 

Again, (I2.2ip holds from this inequality and using £"(g s ) > £"{d). Note that g s+ i > c > 
e 1 ^ and that g s+ i < 1 implies l<s + l<fc + l. One may argue similarly as above to 
get (I2T23|) . 
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Lemma 2. Let r] > and < 5 < c. Suppose that I and I' are fixed integers with 
l<l<l'<k + l. If m p < t] for every 1 < p < I — 1, then 

E|WiW 2 ---W { _i-l| <Mr]. (2.34) 

If c — 5 < q p < qi> for every I < p < I', then 

EWiW 2 ■ ■ ■ Wi-!\WiWi+i ■ ■ ■ Wv-i - 1| < My/q v -c + 5. (2.35) 
Here, M depends only on £. 

Proof. Similar arguments as (14.468) and (14.469) in [18] will yield the announced results. 

□ 

Recall the definition of the Parisi measure fip. It is the weak limit of a sequence of 
probability measures fi n G MIN(e n ) with e n \, 0. For clarity, in the following, we will only 
use (k, m, q) to denote the triplet corresponding to /i n . One has to keep in mind that this 
triplet depends on n and e n . Note that since /ip is nontrivial, we may assume k > 1 for 
all n > 1. Let < s < k + 1 satisfy q s < c < q s +i- Without loss of generality, we may 
assume that the limits of q s , q s +i, and m s exist and they are denoted by c_, c + , and m c , 
respectively. Note that if c_ < c < c + , then c_ < c implies m c = 0, but on the other 
hand, c < c + implies minsupp/Up > c, a contradiction. Therefore, we can further assume 
that one of the following occurs. 

(i) C- = c and there is some < d < c such that q s > d for all n. 

(ii) c + = c and q s+ \ < 1 for all n. 

Lemma 3. We have that 

limE|Wi---W s _i-l| = 0. (2.36) 

If in addition, (ii) occurs, then we also have 

lim \Wi---W a -l\ = 0. (2.37) 

Proof. Let < 8 < c be fixed. Suppose that 1 < / < s + 1 is the largest integer such 
that qi-i < c — 5. Since lim^oo /i n ([0, c — 5)) = 0, we have that for any rj > 0, m p < rj for 
every < / — 1 provided that n is sufficiently large. Since c — 5<q p <q s <c< q s+ \ for 
I < p < s, using (12.351) twice, we get 

EWiW 2 ■ ■ • ■ ■ • W s .x - 1| < M^q s -c + 5 < AlV6, (2.38) 

EW!W 2 ■ ■ ■ Wi-i\WiWi+! ■ ■ ■ W s - 1| < Mv/g s+1 -c + 5. (2.39) 
From the triangle inequality, ()2.34|) . and f !2.38|) . we have that 

limsupE|W r il^2---W / s _i - 1| < limsupEW / iW / " 2 ---^_i|^W / ;+i---W / " s _i - 1| 

+ limsupE|WW 2 ---W / ^ 1 - 1| 
< MVS + Mr]. 
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Similarly, if (ii) occurs, using the triangle inequality, (12.341) . and (I2.39p . we obtain 
limsupE|W 1 W r 2 ---W s -l| < \imsnpEW 1 W 2 ---Wi. 1 \WiWi +1 ---W s -l\ 

n— >oo n—too 

+ \imsupE\W 1 W 2 ---W l ^ 1 - 1| 

n— >oo 

< lim My/q 8+ i -c + 5 + Mr) 
= M\Tb + Mr]. 

Since 5, 77 > are arbitrary small numbers, passing to the limit implies f!2.36|) and (I2.37p . 

□ 

Now let us proceed to prove (I2.15P and (12. 16[) as follows. Suppose that (i) holds. Then 
from (12191) . (a) in Proposition GQ (Ejp, d2~2T]) . and fl2T36|) . we have 

e(^( X ,c)) 2 = lim EA' S (Q 2 

\ OX J n->oo 

= lim EW 1 ---W S . 1 A' S (Q 2 

n— >oo 

= lim g s 

n— >oo 
= C 

and 

£"(c)E (^?(X^)) 2 = n lim e'(q s )EA':(Q 2 

= lim e{q s )W 1 ---W s ^ 1 A" s {Q 2 

n— >oo 
< 1. 

If (ii) holds, then we argue similarly by using from (I2.19p . (a) in Proposition [TJ (12.221) . 
(I2.23P , and (I2.37P to conclude (I2.15P and (12.161) . This completes the argument of our proof. 

3 Controlling the coupled free energy 

We will recall Guerra's replica symmetry breaking bound for the coupled free energy 
(II. lip . From this, we derive a manageable bound by using suitable chosen parameters. 
As one shall see, this derivation naturally gives rise to a crucial function that will be used 
in Section H] to determine the unique constant Uf as stated in our chaos results and also 
to control the behavior of the overlap R(cr, r) as (11. 13ft . 

3.1 Guerra's bound 

Recall the two systems corresponding to the Hamiltonians and in (11.61) . We 
denote by Z l N and Z\ the partition functions, by V\ 1 (m 1 , q 1 ) and "P| 2 (m 2 , q 2 ) as in ( 12. 21 ). 
and by h 1 ) and V 2 ((,2,2, h 2 ) the variational formulas as in ( 12.41) associated to the 
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two systems, respectively. Set u^i = w 2j2 = 1 and Wi )2 = ^2,1 — u f° r some —1 < u < 1. 
Recall ^1,1, £ 2i2 , and £i )2 from (jl.7p . Define £ 2 ,i = £1,2 and 9j,f(x) = x^j,(x) - £j,f(x) for 
1 < j) j' < 2. Let k > 1 be an integer and let (2/*, y 2 ) be jointly centered Gaussian r.v. for 
< p < k with 

where (/^'Oo<p<K+iA<i,j'<2 are real numbers satisfying pj J = 0, ^ J +1 = Uj t f for 1 < 
j,j' < 2. These pairs (y p ,y 2 ) are also assumed to be independent of each other. Let 
no = < n\ < ■ ■ ■ < n K _i < n K = 1. The Guerra replica symmetry breaking bound for 
the coupled free energy is stated as follows. 

Theorem 6 (Guerra). We have 



Pn,u < Y (X) -\u-~J2 E M^'W'i) - 0j.M J '))- (3-2) 

j,j'<2 0<p<K 

where Yq(X) is defined as follows. Starting with 

Y K+l (X) := log I cosh I h 1 + v\ ) cosh W + E ^ ) coshA 




+ sinh I h 1 + > ' yi I sinh I /i 2 + > ' yl I sinh A 




we define decreasingly for p > 1, Vp(A) = n p 1 logE p expn p Yp + i(A) ; where E p denotes the 
expectation in the r.v. y\ and y 2 for n > p. In the case of n p = for some p, we set 
Y p (X) = E P Y P+1 (X). Finally, Y {X) = EYi(A). 

Recalling Guerra's original bound from (12.31) . (13.21) is a kind of two dimensional bound 
for the coupled free energy. Its proof is essentially the same as that of Proposition 14.12.4 
[T8] and a more generlized version can be found in Section 15.7 [15] . Such bound has 
played a very fundamental role in Talagrand's original proof for the validity of the Parisi 
formula [16J, where the two systems he considered are exactly the same, i.e. (3\ = /3 2 , 
Q l = Q 2 , and h 1 = h 2 . In our case, since these external parameters may be essentially 
different, how to find suitable parameters k, (n p ) < p < K+ i, (pW )o<p<k+i,i<j'J'<2, and A to 
control this bound becomes a very intricate issue. To illustrate the main difficulty, note 
that from the definition (II. lip of p^, u and (12. 3p . one sees obviously for all u G Sn, 

Pn, u < -^ElogZ^+ -^ElogZ^ < ^(m 1 ,^) +P fc 2 2 (m 2 ,q 2 ) (3.3) 

for arbitrary choices of the triplets (&i,m 1 ,q 1 ) and (/c 2 , m 2 , q 2 ) satisfying (12. ip . Thus, 
if (13.21) is a relevant bound to investigate chaos problems, one should be able to find 
parameters for (13. 2p to recover the inequality ( 13. 31) . In the next subsection, one will see 
that this could be done for all \u\ < y/c\C2, but the general case remains unclear. 
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3.2 a manageable bound 

The goal of this subsection is to derive the following bound for the coupled free energy. 
Denote by (k\, m 1 , q 1 ) and (k 2 , m 2 , q 2 ) two arbitrary triplets corresponding to probability 
measures /x 1 and [x 2 and by and $2,^ 2 the PDE solutions (J27TJ) associated with £^1, 
fi 1 and £2,2, /-t 2 , respectively. Assume that 1 is an integer satisfying 1 < 1 < min(/ci, k 2 ) + 1. 

Proposition 2. For every \u\ < \fqlq 2 , we. have that 
Pn,u < VKm^q 1 ) +P 2 2 (m 2 ,q 2 ) 




1 t— 1 -. t— 1 

+ zY. m l^M + i) - M$) + 2 E m ^(<? P 2 +i) - M#), 

p=0 p=0 

where x 1 and x 2 are jointly centered Gaussian independent of h 1 and h 2 with E(x x ) 2 = 

We will need a crucial lemma. Let us keep every parameter but A in the statement 
of Theorem [6] fixed. Recall k, (n p ) <p< K , and (?/p)o<p<K,i<j<2 from the last subsection. 
Starting with Dj tK+ \(x) = log cosh a; for j = 1, 2, we define decreasingly for 1 < p < k and 
J = 1,2 by ' | 

d j,p( x ) = — logE p expn p D jtP+1 (x + y J p ). 

Hp 

As usual, we define Dj >p (x) = K p Dj^ p+ i(x + y|) when n p = 0. 

Lemma 4. Suppose that (yl)i< P < K and (y 2 )i< p < K are independent of each other. Then 

F (0) = ED^h 1 + yl) + ED 2A (h 2 + y 2 ), (3.5) 
F o '(0) = ED' lx (h l + yl)D' 2yl {h 2 + y 2 ). (3.6) 

For the second derivative o/Yq, we have for every A, 

< F "(A) < 1. (3.7) 

Proof. The proofs for ( 13. 5f) and ( 13.6f) are exactly the same as the arguments in Proposition 
14.6.4 [18], while the statement ( 13. 7\\ can also be obtained from a similar argument as 
Lemma 14.6.5 [18]. 

□ 

Similar to (I2.17p . we define two sequences of functions (-<4i,p)o<p<fci+2 and (^42,p)o<p<fc 2 +2 
as follows. For j = 1,2, suppose that (-^)o<p<fc,+i are independent centered Gaussian 
r.v. with E(z J p ) 2 = Cj,j( a P +i) ~ ^j,j(lp)- Starting with A j}kj+2 (x) = log cosh x, we define 
decreasingly 

A hp( x ) = -\\ogEexpm J A jtP+1 (x + zl) 
mp 
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for < p < kj + 1, where we let Aj iP (x) = E,Aj >p+ i(x + z 3 p ) when m? v = 0. 

Proof of Proposition [2t Our proof is based on Guerra's bound with special choices 
of the parameters k, (n p ) < p < K , (pp'- 7 )o<p<K+i,i<j,j'<2, and A that will be specified below. 
Without loss of generality, we assume that m\ < m 2 . Define I a = {n : ml +a _ 1 < m 2 < 
m l i+a } for each 1 < a < k\ — i and -/^-t+i = {n : < m 2 < rn\ +1 = 1}. Set for 
1 < a < hi - i + 2, 

a-1 

s(o) = 2a - l + ^|/ n |, 

n=i 

a-1 

t(a) = t + ^|J n |. 

n=l 

Here, |/| stands for the total number of elements in / for any given finite set I. Set 
(p ' , Po 2 ; n o) = (0, 0, 0). For each 1 < a < k\ — l + 1, we set the following numbers 

/ 1,1 2,2 \ / 1 2 2 \ 

lP s (a)+l'P S (a)+l'™s(a)+lJ ~ W t +a,<?t(a), m t(a)J, 

/ 1,1 2,2 \ _ / 1 2 2 \ 

\Ps{a)+2i Ps{a)+2i n <a)+V ~ W t +a> <?t(a)+l > m t(a)+l J , 

(3.8) 

/ 1,1 2.2 \ / 1 2 2 \ 

l/ 3 s(a.)+|/ a .|' Ps(a)+|7 a |' ri s(a)+|7 a |J — (,<? t + a , q t {a)+\I a | -1> m t(a)+\I a | -1 J ) 

/ 1,1 2.2 \ / 1 2 2 \ 

\P s {a)+\I a \ + vPs{a)+\I a \ + V n <o.)+\I a \ + l) ~ lA+a> ?i(a)+|/ a | > m t(a)+|/ a | J • 

Finally, we take k = s(ki — i + 2) + 1 and set 

^ 1,1 2,2 \ / 1 2 1 \ 

{Pn-VpK-l^K-l) = (^ + 1,^ + 1,^+1), 

(p«\ P« 2 , = (?fc 1+ 2, 9fc 2 +i, m 2 k2+1 ), (3.9) 
(Pk'+1,Pk+i) = (^1+2,^2+2)- 

Also, let Pq 2 = and p x p 2 = p 2 ' 1 — u for all 1 < p < k + 1. Easy to see that (n p ) < p < K 
is nondecreasing with n = and n K = 1. From the construction of (p£ J ')o<p<K+i,i<i,j'<2, 
observe that 

(i) we define (p*^, Pp+i) by changing the value in only one of the coordinates from the 
previous step (Pp 1 ,^' 2 ) for every 1 < p < k; 

(ii) e-,/(ppi'i) - Z'uW) = for all j ^ f and 1 < p < «; 
(iii) < ^i,i(o , t) 1 ^ 2 ^2,2(Q , t 2 ) 1//2 by the Cauchy-Schwartz inequality. 

They together ensure the existence of the jointly centered Gaussian r.v. (y p1 y 2 ) for 
< p < k, which satisfy (13.11) and are independent of each other. In particular, (y^y^) 
satisfies E( ?/0 1 ) 2 = ^{q}), E(y 2 ) 2 = ^ 2 (g 2 ), and E^y 2 ) = ^ 2 (u). This completes the 
assignment of the parameters. 
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Now we use these parameters for Y (X). Applying the mean value theorem and (13.71) 
to Y (\) — Xu gives 

Y (X) -\u< F o (0) + (y o '(0) - u)X + y , VA, 

and minimizing the right-hand side of this inequality with respect to A and using (13.21) 
yield 



pn,u < y (o) - ~(r '(o) - uf - i ^M^Ki'i) - ^V/' ))■ (3-10) 

ij'=i p=o 

To complete the proof, our final task is to check that the three terms on the right-hand 
side of ( 13.1 Op together give the asserted inequality. Using definitions of A,, p 's and Dj^s, 
the observation (i), and our construction (I3.8P and (13.91) . one sees that 

D 1A = A ltl and D 2>1 = A 2 , L . (3.11) 

Let us find an upper bound for Y (0). Note that from Jensen's inequality, 

A jA x ) = —■ logEexp mlA jtP+1 (x + zl) > EA jtP+1 (x + zl). 
m J p 

So by decreasing induction on p, 



\ 0< P <L J 



where Xq is defined as in (I2.2p using (kj, raP , q 3 ), and h? . Since y 3 is equal to ^ 0<p<t z 3 p 
in distribution, it follows from this inequality, ( 13. 5p . and ( 13.111) that 

Y o {0) <X] + Xl (3.12) 

Next, we compute V '(0). Similar to (12 . 181) and ( 12.191) . the function Aj >t and ®j !fi i are 
related by A^ L {x) = (x, q{ ). From this, (13. 6p . and (13.111) . 



F o '(0) = E^^ 1 + 2/U)^f^ 2 -ui'i: )• (3.13) 



Finally, a direct computation using ( 13. 8p . ( 13. 9p . and the observation (ii) leads to 

2 K 

2 



j'=l p=0 

= 2 E - m$) + 2 E "■jcm&.i) - m#)- 

Combining (I3.10p . (13.121) . (I3.13p . and this equation together completes our proof. □ 
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4 Determination of the location for the overlap 



Recall the Gibbs measures G\j and G 2 N using the Hamiltonians H]^ and H\ from fll.6p 
for the two mixed even-spin systems introduced in Section [TJ Throughout this section, 
we will assume that their external fields h 1 and h 2 satisfy E(/i 1 ) 2 ^ and K(h 2 ) 2 ^ 0. 
For j = 1,2, let us denote by /zp a Parisi measure for the j-th system and by the 

function defined as in ( \2.8\\ using £,jj,h? , p? P . From the positivity of the Parisi measure 
(12. 5p . Cj = minsupp/ip > 0. Let us also remark that Cj < 1. Indeed, as in (12.131) . if Cj = 1, 
it means that /ip is replica symmetric and Cj has to satisfy Cj = Etanh 2 F < 1, where 
some standard Gaussian w. We will use the bound ( 13.41) to determine 
the constant Uf stated in Theorems (TJ El and [3] and furthermore, to study the behavior 
of the overlap R(cr, t) in [— y^Cicjj, y/c\c-^. 

4.1 Determination of uj 

Suppose that < V\, t>2 < 1. We define 

d&l 1 <9$9 2 

cf> Vl!V2 (u) = ^^^(h 1 + X \ vi)^^{h 2 + x 2 , v 2 ) (4.1) 

for \u\ < y/viV2, where x 1 an d X 2 are jointly centered Gaussian with E(% 1 ) 2 = 
E(x 2 ) 2 — £22(^2), and ^x l X 2 — £i 2 ( u )- As we have explained in the proof of Theorem [3, 
the function (f> VuV2 is well-defined. The constant Uf can be determined by 4> Cl ,c 2 through 
the following proposition. 

Proposition 3. Cl ,c 2 fnaps [— y/c\C2, ^J~C\C?\ into itself and it has a unique fixed point Uf. 
In addition, if h 1 and h 2 are independent and symmetric with respect to the origin, then 
Uf = 0. 

Proof. Since E(/i 1 ) 2 ^ and E(/i 2 ) 2 ^ 0, from (d) in Proposition [lj we have that 

E ^ (/i i +xi) )2= (4.2) 



Let vi = c 2 , v 2 = c 2 , and set 



dx 

]j_ 

dx 2 



^(^) E ^& i ^ + ^>c J ) 2 <l. (4-3) 



= ^ P (x,d) and F 2 (x) = ^ p (x,c 2 ). 

Then (jOJ) and (TOD imply fl2lUD and (12111 . In addition, from (b) in Proposition HJ i*i 
and F 2 satisfy the required assumptions of Theorem [5) Thus, 4> Cl ,c 2 maps [— a/ciC 2 , ^/cic 2 ] 
into itself and has a unique fixed point u^. Suppose that h 1 and /i 2 are independent and 
symmetric with respect to the origin. From (c) in Proposition (TJ since 

^(•, Cl )and^(-,c 2 ) 
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are odd functions, one may see clearly that 

CliC2 (O) = ^^^(h 1 + X \ d) • E^^(/i 2 + x 2 , ci) = • = 0, 
where in this case x 1 an d x 2 are independent. Thus, «/ = and this completes our proof. 



4.2 the behavior of the overlap in [—y/city, y/c\C2\ 

Recall that (■) is the Gibbs average with respect to {G X N x G 2 N )^" yo . The behavior of 
the overlap R(cr, r) inside [—y/o[c2, ■y/clci] can be described by the theorem below. For 
c i < v i < 1) c 2 < f 2 < 1, and £ > 0, we define a set 

{x : -y/viv 2 < x < y/c^, \x - Uf\ > e}, if u f = yjc x c 2 , 
{x : —y/cic 2 < x < y/vtv 2 , \x - Uf \ > e}, if Uf = —y/cic 2 , 



S e (uf,v 1 ,v 2 ) = < 

{x : -y/v x v 2 <x< y/v^, \x - Uf \ > s}, if \u f \ < ^/c x c 2 . 

Theorem 7. Let Uf be the fixed point of <f) ci ,c 2 - F° r an V £ > ; there exist c x < v x < I, 
c 2 < v 2 < 1, and K > that are all independent of N such that for N > 1, 

E(/(i?(<x,r) E S £ (u f ,v x ,v 2 ))) < K exp f-^\ . (4.4) 

The core of the proof for this theorem is based on the following proposition. Similar 
to (12.41) . let T 71 ^!,!, h l ) and V 2 (£, 2>2 , h 2 ) be the variational formulas corresponding to the 
two systems. 

Proposition 4. For any two < v x ,v 2 < 1, we have that for \u\ < ^v x v 2 , 

Pn,u < V 1 (£1,1, hi) + P 2 (6,2, h 2 ) - - (4> Vlt v 2 (u) - uf 

2 (4.5) 

+ {OiM) ~ ^i,i(ci))+ + {O2M) ~ Mc2))+. 

Proof of Theorem [71 Since the proof for the three cases of Uf are the same, we will 
only present the detail for the case Uf = ^c x c 2 . For e > 0, since Uf is the unique fixed 
point of 0ci,c 2 ; it implies 

£* := - min{|0 CliC2 (w) — u\ 2 : u G S E (u f , c x , c 2 )} > 0. 

Recall S'tv := {i/N : — iV < i < N}. Taking v x — Ci,v 2 — c 2 and applying (14. 5p . we have 
that 

Pn,u < P\£i,i, h 1 ) + P 2 (6, 2 , h 2 ) - e\ (4.6) 
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for all AT > 1 and u G Sjy H S E (v,f, Ci, c 2 ). On the other hand, since the mapping 
(w,t>i,t> 2 ) l- > 4>vi,v2{ u ) is a continuous function on the space 

{(«, Di, f 2 ) : < «i, v 2 < 1, \u\ < y/V!V 2 } 

and it satisfies that (0 Cl ,c 2 ( — u f)+ u f) 2 > and \im. Vj ± Cj (0j ) j(vj) — 8jj(cj))+ = Oforj = 1,2, 
there exist c 1 < V\ < 1, c 2 < u 2 < 1, and e 2 > such that 

- m) 2 - - diM)) + - (B 2>2 {v 2 ) - 9 2<2 (c 2 )) + > e\ 

for all u <E Sn with —yjv\v 2 <u< —^/c\c 2 and from (14. 5p . these w's satisfy for A^ > 1, 

Piv,« < ^(6,1: ^) + ^(6,2, h 2 ) - e £. (4.7) 
From ( 14.61) and ( 14. 7ft . we conclude that for AT > 1, 

PN,u < V\^,U h 1 ) + V 2 (&, 2 , h 2 ) - mm(el, e* 2 ) (4.8) 

for u G Sn H S E (uf, v i, f 2 ). As an immediate consequence of concentration of measure for 
the Gaussian r.v. C/ 1 , Q 2 and the r.v. (h})i<N, {h 2 )i<^ (see for instances, Theorem 13.4.3 
and the argument of the positivity of the overlap on page 449 in [18J), (I4.4p follows from 

dSD. □ 

Proof of Proposition^ Let (k\, m 1 , q 1 ) and (k 2 , m 2 , q 2 ) be two arbitrary triplets. We 
denote by ^ the probability measure and by $j tl j the PDE solution (12.7ft corresponding 
to the triplet y? . Suppose for the moment that q\ = V\ and q 2 = v 2 for some i with 
1 < i < min(A;i, k 2 ) + 1. Then \u\ < \/ q\q 2 L . Applying (kj, m J , q 7 ), t, and u to Proposition 
|2j we obtain the bound (13 .4p . 

Now we check that (13 .41) will yield (14. 5ft . Let S\ and 5 2 satisfy < S\ < c\ and 
< 5 2 < c 2 . For convenience, we denote by C\ the first term and C 2 the second term of 
the last line of the inequality (13 .4p . If q{ < Cj — Sj, then 

Cj < max{mj : q J p < Cj - Sj} ^ (OjMl+i) ~ e iM)) 

0<p<i-l 

< ^([0,^-^)0^(1); 

if q{ > Cj — Sj, then 

Cj < max{mj : q 3 p < Cj - Sj} ^ {OjMi+i) ~ e j,M 3 P )) 

0<p<t-l 

0<p<b—l:qp>Cj—8j 

< ^([o, cj - Sj})9j d (i) + 6j,j{vj) - ej,j(cj - <y . 

As a summary, we have 

Cj < fr'i d Cj - Sj])9j,j(l) + {djjivj) - ej,j( Cj - Sj)) + . (4.9) 
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Finally, combining ( 13. 4p and ( 14. 9p . we obtain that 
PN,u < ^(m 1 , q 1 ) + V 2 k2 (m 2 , q 2 ) 



2 «9a; v ^ ' A ' <9x v * ' A ' ^ 7 U J (4.10) 

+ //([O, d - tfiDMl) + (M^i) " M c i - *i))+ 
+ /i 2 ([0, c 2 - 5 2 ])0 2>2 (1) + (0 3>2 (i; 2 ) - 6 2t2 (c 2 - 5 2 )) + . 

where xi and X2 are jointly centered Gaussian with Ex 2 = i(i>i), Exf, — £22(^2), and 
EX1X2 = ^1,2 Taking any two sequences of triplets (ki tTl , m* , q* ) n >i and (fc 2) „, m 2 , q 2 ) n >i 
such that their corresponding probability measures (/^) n >i and (^) n >i converge weakly 
to /ip and /ip, respectively. We may also require that q\ n = v% and qf n = v 2 for some 
1 < t n < min(fci jn , fe2,n) + 1 f° r each n. Applying these triplets to 1 14. 10p . (a) in Proposi- 
tion (TJ and then letting 8j j. 0, the asserted result follows. □ 



5 Controlling overlaps using identities 

Recall from Section CD that G\j and G% are the Gibbs measures corresponding to the 
Hamiltonians and as in 1 I1.6P using temperature /3i and f3 2 , disorder Q 1 and Q 2 , 
and external field h 1 and h 2 , respectively. Throughout this section, we will assume that h l 
and h 2 are jointly Gaussian (might not be centered). Recall that Cj is the minimum value 
of the support of the Parisi measure /i p for j = 1,2. The major goal of this section is to 
prove that under the assumptions of Theorems [T] and [2J the following theorems hold that 
will be used in the problems of chaos in temperature and disorder. Recall the definitions 
of (tp) p >i, C , Ii, X 2 , (Ci), and (C 2 ) from Section [IJ 

Theorem 8. Let t p = 1 for all p G N. Suppose that X\ and X 2 satisfy (C\) and (C 2 ), 
respectively. Then for j = 1,2, 

lim E(I(\R((t,t)\ > y/c'j + e)) = 0, Ve > 0. (5.1) 

// Var(^) ^ /or both j = 1, 2 ; then 

lim E(/(|i2(<r,T)| > V / Cic 2 " + ^)) = 0, Ve > 0. (5.2) 

JV-> 00 

Theorem 9. Suppose that < t p < 1 /or some p £ I\ flX 2 . For j G {1,2}, z/Xj G Co, 
i/ien 115. ip holds. IfVax{hP) 7^ and Xj G C /or both j = 1, 2 ; then we have 1 15. 2p . 

The importance of Theorems El and [9] lies on the fact that they allow us to exclude the 
discussion on the cases \u\ > ^fc] when E(/z J ) 2 = and \u\ > ^/c\c 2 when Var(/i 1 ) 2 7^ 0, 
Var(/i 2 ) 2 7^ in the control of the coupled free energy p^, u using Guerra's bound, which 
are technically very hard to deal with. Our approach to Theorems [8] and [9] is intimately 
motivated by [5J. As we have explained in Section 1, we will derive the Ghirlanda-Guerra 
identities as well as a new family of identities for the overlaps in the coupled system to 
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control the cross overlap R(<t,t) using the overlaps R{a 1 1 cr 2 ) and R(t x ,t 2 ) from each 
individual system. Let us remark that in the statements of Theorems [8] and [9] the first 
parts (15. ip have been considered in Theorems 3, 4 jS], while the second parts (15. 2 p are 
new that strongly rely on the positivity of the overlap ( 12. 6p . 



5.1 Identities for the coupled system 

Given replicas (er e ,r e )e>i, let us denote by 

R\ u = -R((X^, (7^ ) , R 2 g, = R(t^, ) , Ritfl = R((T^ , ) , 

the overlaps within each system and between the two systems. For any bounded function 
/ depending only on the overlaps (Rg£r)e,e'< n , (.Rji>)e,e'<n, and {Rt,t')t,t>< n and any ip G 
C[— 1, 1], we define 

$!,„(/, if}) =E (M^n+i)) " l E (/> E <^, 2 )> - - E E (mRlt)) , (5.3) 

1 - 

V) = E (MiW)) " - E E (M^m)> , (5-4) 

i=i 

1 1 - 

* a>B (/, if}) = E (M^n+i)) " - E (/> E <^« 2 )> " - E E </^(^)> > (5-5) 

1=2 

1 ™ 

* a>n (/, if}) = E (MR n+l7l )) - - E E (M^,i)> • (5.6) 



n 



In what follows, we will prove that these four quantities converge to zero as iV tends to 
infinity for either all even ip G C[— 1, 1] or all if) G C[— 1, 1] depending on the parameters of 
the models. Equations ( j5 .31) and (15. 5ft will yield the familiar Ghirlanda-Guerra identities 
[7], only now the function / may depend on the overlaps of the two systems. As for 
equations (15. 4ft and f 15 .61) . they will provide additional information about how two systems 
interact with each other. We will use the notation throughout the section: 

if) a (x) = x a . 

Write (h 1 , h 2 ) = (x 1 + sig 1 , x 2 + s 2 g 2 ), where x 1 , x 2 G R, s x — Var(/i 1 ) 1/2 , s 2 = Var(/i 2 ) 1/2 , 
and g , g 2 are jointly centered Gaussian with E^ 1 ) 2 = K(g 2 ) 2 = 1 and Eg 1 ^ 2 = t for some 
t G [—1,1]. The following lemma is the key to establish the asserted identities for the 
coupled system. 

Lemma 5. For all p G N, 

lim sup |/3 2 , P a/ 1 _ ^*i,n(/, ^2 P ) | = 0, ( 57 \ 

N -*°° \\f\\oo<l K ' 



lim sup |/3i )PV /l - tp^ 2 ,n(/, ^2 P )| = 0, C5 

/ -* Q0 ||/||oo<l ' 1 ; 

lim SUp |/3l, p $l, n (/,V2p) +^2,p*p^ r l,n(/ ) '02p)| = 0, /r g\ 

lim SUp |/3 2 ,p*2,n(/,^2p) + I3l,ptp^2,n(f^2p)\ = 0. fcin) 
Ar ^ 0D ll/lloo<l 



26 



We also have 



lim sup \s 2 y/l - itj#i,n(/,Vi)| = 0, (5ii) 

N ^°° |]/|]oo<l V ^ 

lim sup |s!^/l - |t[* 2 ,n(/,V'i)l = 0, C5 12 ) 

ll/Hoo<l K ' 
lim SUp |Si$i, n (/, Ipl) + S2^1,n(/,'0l)| = °, 11) 

N ^°° ll/l|oo<l 1 J 

lim SUp |s 2 $2,n(/,^l) + Sl^2,n(/, ^l)l = 0. (e-MN 

JV^oo ii f ii 3<1 W-^^J 



Proof. Our proof basically follows the same argument as Lemma 2 [5]. Let 



N,p 



(T 



and X^ p {r) be the pure 2p-spin Hamiltonian in X^(cr) and X^(r). They are equal in 
distribution to the pair 



t p X NiP (cr) + a/1 — t p Zlf p (a) and ^/T p X NyP (r) + a/1 — t v Z 2 Np 



T 



where we denote by Xjv iP , , Zfj^ p three independent copies of (11.21) . The derivation of 
(15. 7p — (15.1 Op is based on the concentration of the Hamiltonians (see Lemma 1 [5j and 
also Chapter 12 [TS]): as iV — >■ 0, 



Aj,Aj,rJ,I^-^0, (5.15) 



where 



A^iV-^d^^-E^^ 1 ))!), 
Aj = iV- 1 E<|^ iP (r 1 )-E<^ p (r 1 )>|> ) 
Tl = N-'eQX^ct 1 ) -E^^ 1 ))!) 
rJ = iV- 1 E<|X^(T 1 )-E<X^(r 1 )>|>. 



For / with ||/||oo < 1, one may see clearly 



N- 1 |E (Z 2 N ^)f) - E (Z^icr 1 )) E (/> | < AJ, 

iV- 1 |E (Zj^r 1 )/) - E (^Ur 1 )) E (/) | < AJ, 
iV- 1 |E (X^ct 1 )/) - E (X^ 1 )) E (f) | < T p 
^ |E (^(r 1 )/) - E (X^r 1 )) E (/> | < T 



(5.16) 
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A simple application of the Gaussian integration by parts to each term of the left-hand 
side of fl5TTB|) together with (15TT5|) yields (f5T7jl . (O]) . (15T9|) . and flBTTOl) . One may refer to 
Lemma 2 [5] for detail. Similarly, since ft, 1 ,/?, 2 are jointly Gaussian, (15.111) . (I5.12p . (15.131) . 
and (I5.14p can also be treated by applying the same argument as above to the external 
fields. 



We will need the following lemma. 
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Lemma 6. Let j G {1,2}. Suppose that 

lim sup |tt iin (/,V)| = (5.17) 

N ^°° ll/l|oo<l 

/ioWs with ip = ip a for some a > 1. If a G 2N, i/ien (I5.17P a/so ZioZds /or a// even ^ G 
C[-l, 1]; a = 1, i/ien flBTTTD /joMs /or a// ^ G C[-l, 1]. 

Proof. It suffices to consider j = 1. Observe that for £ > 2, using symmetry between 
replicas yields 

E <((i?i,i) a - (Ri,i) a ) 2 ) = 2E <(i?i,i) 2a > - 2E ((i?i,i) a (i?i, 2 ) a ) = -2* 1 , 1 (/, (5.18) 

by definition of ^i >n in (15.4p with n = 1 and / = (i?i.i) a . If a G 2N, using \x—y\ a < \x a — y a \ 
for all x, y > and (15.181) . we can write 

E(\\R hl \ - \R hl \\) < (E(\\R ltl \ - | J R M || 2ffl » 1/2a 

< (E<(( J R 1 , 1 ) a - {R l/ ) a f)) ll2a = (-2* 1 , 1 (/,^)) 1 / 2a 

Since (15.17P holds for tp ai this inequality implies that \R\/\ ~ for all £ > 2 and 

clearly (I5.17P holds for all even if> G C[— 1, 1]. If (I5.17P holds for ipi, then (15.181) implies 
i ~ Rii for all ^ > 1 and so (I5.17P holds for all ip G C[— 1,1]. This completes our 
proof. 

□ 

Recall the positivity of the overlap (12. 6 p that if E(/i J ') 2 7^ 0, one may pass to limit to 

see 

lim E (/(i^ > 0, VI < £ < n)> = 1, Vn > 1. (5.19) 

We continue to state two useful propositions that will need the help of Lemmas 15] [6] and 
(I5.19P under additional assumptions on the parameters of the models. 

Proposition 5. Suppose that t p = 1 for all p > 1. For j G {1,2}, if Xj satisfies (Cj), 
then ( 15.17P and 

lim sup |$ i)ft (/,^)| = (5.20) 

^ QO ||/||oo<l 

/ioW /or a// even ^ G C[— 1, 1]. //X,- satisfies (Cj) and Var(h^) 7^ for both j = 1, 2, t/ien 
(I5TT71) /ioWs for both j = 1, 2 and a// V e C[-l, 1]. 

Proof. To prove the first assertion, it suffices to consider j = 1. Since Xi satisfies condition 
(Ci), there exist .4 C with ^4 G Co, po G Xi\.A, and i/Gl such that 02, P = vf3i tP for all 
p G A and /32, Po 7^ v(3i >Po . Since f3i tPo 7^ 0, z/ := (3 2 ,p / Pi, Po 7^ v. From (15. 9p . we have that 

lim sup |$i,„(/, ^ 2po ) +z/*i,„(/,V'2po)l = (5.21) 



= <1 
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and that using f3 2 , p = vfli, p and /3i jP 7^ for all p G A, 



lim sup |$i,„(/, ^2 P ) + ^i,„(/,^ 2 p) I = 0. (5.22) 

Ar- ^ Q0 ll/Hoo<l 

Since i G C and -?/>2po * s even ) we can approximate ip 2po uniformly by the linear combi- 
nation of 1 and ip 2p for p G A to obtain 

lim sup |$i, n (/, ^ 2po ) +^i,n(/,-02 Po ) I = 0. (5.23) 

From v v', (I5.2ip and (15. 23j) imply that (I5.17P holds for ip 2po and from Lemma [6], (15.171) 
holds for all even C[— 1, 1]. This together with (15. 22ft implies (15.201) for all ip 2p with p G A 
and then A G Co yields ( 15.20j) for all even ip G C[— 1, 1]. This completes the proof of the 
first assertion. 

Next, suppose that Xj satisfies (Cj) and Var(/i J ) 7^ for both j = 1,2. The use of 
ipi(x) = \x\ + 2min(0,x), the positivity of the overlaps (15.19j) . and the first assertion 
f l5^0|) leads to 

limsup sup \$j, n {f, ipi)\ < limsup sup \$ j>n (f,\x\)\ 

N^oo ||/||oo<l AT->oo ||/||oo<l , 2 ^ 

+ 21imsup sup |$j n (/, min(0, x))\ = 0. 

^^•OO ll/l|oc<l 

Note that s h s 2 ^ 0. Let us use l ETTTj) and fQ2]) if |i| < 1 or use (IBTTBI) . (Oijl . and 
f l5T24|) if |*| = 1 to get (EZD for ip = ipi. Consequently, fl5TTTj) holds for both j = 1, 2 and 
all ■?/> G C[— 1, 1] by Lemma |6j This finishes our proof. 



Proposition 6. Suppose that < t p < 1 for some p G T\ flX 2 . T/ien (I5.17P holds for both 
j = 1,2 and a// even ^ G C[— 1, 1]. For j G {1,2}, i/Z 3 - G C , then (I5.20p /io/ds /or a// 
even ip G C[-l, 1]. IfVax(h j ) ^ and X,- G C /or 60^ j = 1, 2, t/ien (I5TT7]) holds for both 
j = 1,2 and all ip G C[— 1, 1]. 

Proof. Since /?i iP , /?2,p 7^ and t p < 1, one may see clearly that ( 15. 71) . (15 .81) . and Lemma [6] 
together imply the first assertion. Next, using the first assertion together with (I5.9P and 
fIBTTOl) yields that if Xj G C for some j G {1,2}, then (15^01 holds for all even ip G C[— 1, 1]. 
This proves the second assertion. 

Finally, suppose that Var(/i- ? ) 7^ and Ij G Co for both j = 1, 2. Note that s\, s 2 7^ 0. 
If \t\ < 1, we use floTTT]) and fl5TT2l to see that for j = 1, 2, (15371) is valid for both j = 1, 2 
and ip = ipi and from Lemma El this is also true for all t/> G C[— 1,1]. Suppose that 
|i| = 1. Using the relation x = \x\ + 2min(x, 0), the positivity of the overlaps (I5.19p . and 
the second assertion, we also get (15.241) for both j = 1,2. Applying this to (I5.13P and 
(I5.14p yields that (I5.17P for both j = 1,2 and ip = ipi and thus, from Lemma El this is 
also true for all ip G C[— 1, 1]. This completes our proof. 
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5.2 Proofs of Theorems [8] and [9] 

The proofs of Theorems [HJ and [9] rely on the following two propositions. 

Proposition 7. Suppose that ( 15 . 1 7|) holds for both j — 1,2 and a// even r/> G C[— 1,1]. 
For j G {1, 2}, i/ fOUj) /jo/ds /or a// even ip G C[-l, 1], then fl54]) holds. 

Proposition 8. For both j = 1,2, if flBTTTD holds for all ip G C[-l, 1] and (15T20D /jo/ds 
/or a// even ip G C[— 1, 1] ; i/ien (15. 2p /io/ds. 

Since the proofs of these two propositions are exactly the main ingredients of Theorems 
3 and 4 in [5], we will only sketch the proof for Proposition [8] as follows. Suppose that for 
both j = 1, 2, flSTTTj) holds for all ip G C[-l, 1] and flPU]) holds for all even ^ G C[-l, 1]. 
Observe that from (I5.17P and using symmetry between replicas, they essentially imply 
Ri t i ~ Ri^i for all £,£' < n and n > 1. If (15. 2j) is not true, then R\^ > \/ c\c! 2 has nonzero 
probability for some d x ,d 2 satisfying c\ < d x < 1 and c% < < 1. From the Ghirlanda- 
Guerra identities (see Lemma 4 [5]), the following holds with nonzero probability: 

\Re,e\ > V c[c' 2 , \R\i>\ < c", \R% j£ i\ < c' 2 ' 

for all c", c 2 satisfying c\ < c'[ < c[ and c 2 < c' 2 ' < c' 2 . However, using the Cauchy-Schwartz 
inequality to the usual inner product of iV _1//2 (cr 1 + • • • + cr n ) and A^~ 1/ ' 2 (t 1 + • • • + r n ) 
leads to 

V^ 2 < \R ltl \ « — 
This forms a contradiction since indeed \[d[d~ 2 < y / c' 1 c' 2 . 

Proof of Theorem [81 For both j = 1, 2, since Xj satisfies (C^), it follows by Proposition 
[5] that floTTTj) and ( 15301 hold for all even ip G C[-l,l]. Thus, (jSHJ) follows for both 
j = 1,2 from Proposition [71 If, in addition, Var^) 7^ for both j = 1,2, then again 
from Proposition 0, (I5.17P holds for all ip G C[— 1, 1] and Proposition [H] implies (I5.ip . □ 

Proof of Theorem [9} From the given condition < t p < 1 for some p G X x fl X 2 , we 
know that (I5.17P holds for both j = 1,2 and all even if) G C[— 1, 1] by Proposition [61 
For j G {1,2}, if Zj G Co, ( 15.201) is true for all even ift G C[— 1, 1] by Proposition [6] and 
consequently, (15. ip holds by Proposition [71 If Var(/i J ) 7^ and Ij G Co for both j = 1,2, 
then (EUJ) is valid for all ip G C[-l, 1] and (PUD holds for all even ip G C[-l, 1] by 
Proposition [6] and consequently, (I5.2p holds by Proposition [HI □ 




6 Proofs of Theorems H [2], and [3 

Our last section will be the proofs of Theorems [H [21 and [3] that are based on our main 
results derived in all previous sections. 
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Proof of Theorem Using the given conditions, Theorem [S] implies (15. ip for both 
j = 1,2. For j — 1 or 2, if E(/i J ) 2 = 0, then from Theorem HI Cj = and so from (15.11) . 
(II. 8p follows. If Var(/i J ) ^ for both j = 1, 2, then from Theorem!?! for e > 0, there exist 
ci < v± < 1, C2 < V2 < 1, and K > that are independent of iV such that ( 14.4p holds for 
all > 1. On the other hand, from Theorem M, we also have 



V-^oo 



lim E(/(| j R(ct,t)| > V^)) = (6.1) 



for all c\ < v[ < vi and C2 < v' 2 < v-i. Combining this with (14. 4p gives (II. 9p . □ 

Proof of Theorem [2} This part of the proof is very similar to that for Theorem [TJ 
Suppose that E(/i J ') 2 = and Ij G C for some j = 1, 2. From Theorems 0] and [9j (11.81) 
follows. Suppose that Var(/i J ) ^ and Xj G Cj for both j = 1, 2. From Theorem [7J there 
are c\ < v\ < 1, < v% < 1, and if > independent of iV such that (14. 4p holds for all 
AT > 1. Also, from Theorem for any (v[,v' 2 ) with c± < v[ < V\ and c 2 < v 2 < v 2 , we 
have flBTTj) . This together with ffl~4"|) implies fTT9l) . □ 

Proof of Theorem G2 Since = (3 2yP , t p = 1 for all p > 1, and h 1 , h 2 are identically 
distributed, the two systems are equal to each other in distribution. Thus, we may pick 
[ip = fjip and simply denote them by /ip. Let £ := £^1 = £2,2 = £1,2 an d c := minsupp/ip. 
Note that c > since E(/i 1 ) 2 = E(/i 2 ) 7^ 0. Let Uf be the fixed point of CiC from 
Proposition [31 We claim that \uf\ < c. If Uf = c, then using cc (mj) = Uf and (14.21) 
implies 

E (ikT^ + X ' C) " IfcT^ + X ' C) ) 2 = 2C " 2Uf = °' 
where x is centered Gaussian with variance £'(c) independent of h l ,h 2 . This means that 

^ L ( hl + X,c) = ^(h 2 + X ,c) a.s. 

However, since 9 ^q x p (■, c) is strictly increasing from (b) in Proposition (TJ we obtain h 1 +x = 
h 2 + x a - s - an d thus, /i 1 = h 2 a.s. forms a contradiction. Similarly, if Uf = — c, then using 
(pc,c( u f) = u f an d (14-21) yields 

E i^r {hl + x ' c) + ^ (/l2 " *> c) ) 2 = 2c + 2Uf = 0) 

where x is defined as above. This means that 

^ (k . +X ,c) = -^( k »- X ,C )M . 

Since (-, c) is odd and strictly increasing from (6) and (c) in Proposition [TJ it follows 
that h 1 + x — ~h 2 + x a - s - a nd thus, h 1 = —h 2 a.s., a contradiction again. Thus this 



31 



completes the proof of our claim. Now for e > 0, from Theorem [7] and (??), there are 
c < Vi,v 2 < 1 and K > independent of iV such that for all iV > 1, 

E(I(\R(o-,t)\ < yfiwi, \R(<r,T)-u f \ > e)) < Kexp ^-^J . (6.2) 

Recall Sn := {i/N : —A" < 2 < A^}. An advantage brought by the assumptions 
on the parameters for the two models is that under this setting it is slightly easier to 
find parameters to control Guerra's bound that yields the following statement: There are 
constants Ki, K 2 > depending only on £ such that if < d < c" < 1 with £'(c")— £'( c ') < 
i^i and (A;, m, q) is any triplet with q s < d and m s > 8 for some 1 < s < k + 1, then 

r" 

PN,u<2V k (m,q)-5K 2 J EF u (h\h 2 ,?(q))?(q)dq (6.3) 
for all u G Sn with c" < \u\ < 1, where 



F u (xi,x 2 ,w) := 



2 

E (tanh(xi + Zy/w) — tanh(x 2 + Z\fw)) , if u > 0, 
E (tanh(xi + Zy/w) + tanh(x 2 — Zy/w)) , if w < 



for some standard Gaussian r.v. z. The proof of (16.31) is based on a series of applications of 
the Gaussian interpolation technique to the iteration scheme of the Parisi functional. One 
may refer to Proposition 11 |4j to a detailed discussion. Let us emphasize that although 
Proposition 11 [1] considers the case h 1 = h 2 , (16. 3p is indeed also true for identically 
distributed h 1 , h 2 (see (6.17) in [1]). Now, we let c" = ^v\v 2 and pick d with c < d < c" 
such that fjLp is continuous at d and £'(c") — £'(c') < K\. By the definition of the Parisi 
measure /ip, it is the weak limit of a sequence of probability measures \i n G MIN(e n ) with 
e n 4- 0. Using this sequence and (I6.3p . we have for all A^ > 1, 

r" 

PN,u<2V(S,h,tJ, n ) -fj, n ([0,d])K 2 J EF u (h\h 2 ^'(q))C(q)dq 
for all u G 5*7v with c" < \u\ < 1 and letting n tend to infinity implies 

r" 

p N ,u<2V&h)-n P ([0,d])K 2 J EF u (h\h 2 ^'(q))C(q)dq. 

Since E(/i x ± /i 2 ) 2 7^ 0, tanh is strictly increasing, and c is the smallest number in the 
support of fip, there is a constant e* > independent of A^ such that for all A^ > 1, 

Pn,u < 2V(£, h) - e* 

for all u G Sn with c" < \u\ < 1. Using this and concentration of measures for the 
Gaussian r.v. Q 1 , Q 2 , and the r.v. h 1 , h 2 as we have used in the proof of Theorem [71 we 
have that 



E{I(\R(a,r)\ > Vw)) < K' exp 



N 
"K' 



for all A^ > 1, where K' > is some constant independent of N. Combining this inequality 
with ( 16. 2 p clearly completes the proof. □ 
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